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Abstract 

We examine the decays t — > cy and cZ° in the Standard Model with an extra scalar 
doublet and no discrete symmetry preventing tree-level flavour changing neutral currents. 
The Yukawa couplings of the new scalars are assumed to be proportional to fermion masses, 
evading bounds on FCNC's from the light quark sector. These rare top decays may be 
visible at the SSC. 
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Flavour changing neutral currents (FCNC's) involving the light quarks are known 
experimentally to be strongly suppressed, placing stringent bounds on the nature of new 
flavour physics. The gauge interaction of the fermions in the standard model has a global 
[£7(3)] 5 flavour symmetry; this is broken to [£/"(l)] 4 by the Higgs Yukawa couplings, and 
the flavour symmetries are broken most strongly for the heavier quarks. If the observed 
pattern of masses and mixing angles reflects an underlying pattern of symmetry breaking, 
it is natural to expect that new flavour physics will also respect this pattern of symmetry 
breaking. Hence, it would couple most strongly to the top quark, for which the flavour 
symmetry is most strongly broken, while coupling only very weakly to the light fermions. 
This may allow the scale of new flavour physics to be as low as the weak scale without 
contradicting current experimental limits on FCNC's for light quarks. 

A simple example is the Standard Model with extra scalars. These new scalars will typ- 
ically have tree-level flavour-changing Yukawa couplings. However, as has been discussed 
by several authors if the Yukawa couplings of the extra scalars are proportional 

to the fermion masses, low energy limits on FCNC's may be evaded because the flavour 
changing couplings to the light quarks are small. The discrete symmetries which are nor- 
mally invoked in two-Higgs doublet models to forbid tree level FCNC's || are therefore 
unnecessary. It has been suggested that these FCNC's may be looked for in b decays, and 
in particular the leptonic decay B s — > (i + \i~ may be observable at hadron colliders @0. 

If this philosophy is correct, one would expect to see the largest effects of these FCNC's 
in t decays. The resulting rare t decays may be searched for at the SSC, where ~ 10 8 tt 
pairs are expected to be produced per year. FCNC's of gauge bosons in both the standard 
model |f7i- ||12|l and in two-Higgs doublet models with discrete symmetries [|13|]-[|15|] have been 
studied extensively in the past. In the Standard Model and two-Higgs doublet models (with 
ratios of Higgs vevs of order one) the branching ratios for t — > cZ° and t — > 07 are less 
than O(10 -11 ) |16[ |17j and so would be unobservable at the SSC. In this paper we will 
calculate the rates for t — > cy and t — > cZ° in the Standard Model with an extra scalar 
doublet, but without the discrete symmetries which prevent tree-level FCNC's in two-Higgs 
doublet models. t We will not discuss the decay t — > eg as the multi-jet background from 
the primary decay mode t — > bW + will make this mode unobservable. We will assume 
that the new scalars are heavier than the top; the case of < m t has been considered 
in H, as has the tree- level decay h — > tc for nth > m t . We note that the latter process 



' The mode t — > cy has also been recently discussed in IT 
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(h — > W+ jets) has no clear signature and will be very difficult to see at the SSC; in this 
case loop effects such as those described here may be the only way to see these couplings 
at a hadron collider. 

We consider a model with two scalar SU(2)w doublets, ip\ and ip^'- 

(3) (1) 

with Lagrangian 

C v = DViD^i + D*VJd m¥ > 2 - V (v?i, <p 2 ) (2) 

where V(</?i, ^2) is the most general potential consistent with the gauge symmetries. Since 
there is no global symmetry which distinguishes the two doublets we may work in a basis 
where only ip\ has a VEV without loss of generality: 

where v = 246 GeV. Three of the components of ip\ become the longitudinal components 
of the W ± and Z°, while the spectrum contains the charged scalars tpf, the neutral scalars 
h° and H° and the pseudoscalar A , where 

H° = V2 [(Reip^-v) cosa + Re (p 2 sin a] , 

h° = V2 [- (Rev?? - v) sina + Re^cosa] , (4) 
A° = y/2[-Im<p%\. 

The mixing angle a is determined by the potential and is a free parameter of the model, 
as are the masses m^±, rrih, ttih and via- The Yukawa couplings to fermions are 

C Y =\¥ j Q i <piU j + Xf.QiifxDj + \f j L i ip 1 E j 

_ _ _ (5) 

where (p^p = iT2<Pi i- With the usual manipulations we write A* 7 , X D and X E in terms 
of the mass matrices V2M u /v, y/2M D Vyv and V2M E /v, where V is the Kobayashi- 
Maskawa (KM) matrix. We have used all our freedom to redefine the fermion fields to 
diagonalise Mjj, MpV^ and Me, so the matrices ^ U ' D ' E are general 3x3 matrices: 

£,dd £,ds £,db 

C I ^cu Ccc Cct I C I Csd Css Csb 
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A priori, the £'s are all free parameters, and are constrained in the light quark sector from 
the lack of observation of FCNC's. Two possible forms for the scalar couplings, motivated 
by the observed structures of the KM and fermion mass matrices, are the Cheng-Sher (CS) 
ansatz fill 



./m;ra; 



V 

and the Antaramian, Hall and Rasin (AHR) ansatz (for Higgs vevs V\ = v% = v) 
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In this work we will not make a specific ansatz for the £'s but will simply assume that they 
are roughly proportional to powers of quark masses, allowing us to retain only and the 
flavour changing couplings and £ c t. In general the £'s will also be complex, introducing 
additional CP violation into the theory; this will not be important for our results. 
The general form of the amplitude A (t — > c + V ) where V = 7 or Z° is 

A =TrT a - (Ar + Bj^+tCa^^+tDa^^) u t e^ (9) 

where u t , u c and are the incoming and outgoing spinors and the gauge boson polar- 
isation vector respectively The coefficient functions A, B, C and D are computed from 
the diagrams in fig. |. There are contributions from both neutral and charged scalars in 
the intermediate states; note that the charged scalar couplings are not proportional to the 
KM matrix in this model. The expressions for the coefficient functions are lengthy and are 
given in the Appendix. For the photon, electromagnetic gauge invariance implies that the 
vector and axial vector form factors A and B vanish. In terms of the coefficient functions 
the decay widths are 

F(t - cy) = -^m, (|C| 2 + |D| 2 ) 

2 

-6mlRe(A*C - B*D) + m|(^f + 2)(\C\ 2 + \D\ 2 

mi 



from which we compute the branching fraction by normalising to the rate for t — > bW 

To avoid an excess of free parameters, we have plotted the branching ratios as a 
function of a common scalar mass, ra^± = ra^ = ran = m A = M in fig. We have also 
set the flavour changing couplings of the charged scalars, neutral scalars and pseudoscalar 
to be equal to a generic coupling constant £ tc , where £ tc ~ £ tc ~ ^ ct ~ (£tc ±£ct)/2. These 
simplifications do not qualitatively change our results. We have multiplied our branching 
fraction to Z°'s by the 6.7% branching fraction for Z° —> e + e~ ||19|| , as the hadronic 

decays of the Z° have an insurmountable background from the dominant two-body decay 
of the top t — > bW — > b + hadrons. 

For an ansatz of the form (|7|) we expect (£,tt£,tc) 2 ~ ra\ra c /v A ~ 10 -3 . The more 
complicated anzatz (|j) gives a similar estimate. Given the expected ~ 10 8 tt pairs expected 
per year at the SSC, this corresponds, for light scalars with masses of order the t quark 
mass, to at best only a few events per year in the photon channel. For larger couplings, 
the expected signal of course dramatically improves. 

It is useful to examine our results in the context of other limits on the scalar masses 
which have been discussed in the literature. The most stringent limits come from B° — B° 
and K° — K° mixing. For the AHR ansatz (R) , these give lower limits M > 400 GeV and 
M > 500 GeV respectively 0. In a recent work ||], Chang, Hou and Keung have calculated 
the two-loop contributions to \i — > using the CS ansatz ([?]). From the current upper 
limits on this decay mode they placed a lower bound of M > 200 GeV. Other processes 
place lower limits on M which are less than the t quark mass and hence do not constrain 
our results. It is important to note, as pointed out in and ||], that these constraints 
arise from couplings to the down-type quark and lepton sectors only. It is conceivable 
that flavour changing couplings are large only in the up- type quark sector, for which the 
constraints on M are much weaker. The possibility of M ~ rat with large flavour changing 
couplings in the up sector is not excluded. In the absence of any compelling theoretical 
reason to prefer a particular choice of ^'s we feel it is best to simply regard them as free 
parameters to be measured or constrained at the SSC. 

In conclusion, we have calculated the branching ratios for t — > cry and t — > cZ° 
in the Standard Model with an extra scalar doublet, but without discrete symmetries 
preventing tree-level FCNC's. For flavour changing couplings suggested by simple ansatzes 
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for the Yukawa couplings these decay modes would not be observable at the SSC, given the 
constraints on the scalar masses from other processes. However, these constraints may be 
evaded if flavour changing couplings are larger in the u quark sector than for the d quark 
and lepton sectors. In this case, the flavour changing couplings and scalar masses are 
virtually unconstrained. Consequently, sizeable branching ratios for t — > 07 and t — > cZ° 
are possible. To determine whether or not these decays are observable at the SSC requires 
a thorough background study; we have not attempted this in this work. 

We wish to thank Ann Nelson and David Kaplan for numerous discussions. This 
work was supported in part by DOE grant DE-FG03-90ER40546 and by National Science 
Foundation Grant PHY-8958081. MJS acknowledges the support of a Superconducting Su- 
percollider National Fellowship from the Texas National Research Laboratory Commission 
under grant FCFY9219. 



Appendix A. Expressions for the Coefficient Functions 

For simplicity, we set the mixing angle a to zero; the flavour changing couplings then 
only involve if2- We split each coefficient up into contributions from graphs with neutral 
scalars, graphs with pseudoscalars, graphs with both neutral scalars and pseudoscalars and 
finally graphs with charged scalars: A = A h + A A + A M + A c . The contribution from 
graphs with only neutral scalars is given by 



C h 
D h 



A h = j\x (-x log ^ + log 7^ (£v a v - i h A a A ) 
'/ 

J dx (-x log ^ + log 7^ (£v a A - i h A a v ) 
+ jdxdy [(- 1 - 1 °g^ + ^) fevOA + eW) 



+ J dxdy 
m 2 t {x + y-2) . h 
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where we have defined the functions 
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0, 



\ — (1 sin U - ). a , . 

4cos^vk 3 WJ A 4cos9 w 



for the Z°. The products of Yukawa couplings are 



a z - 9 

a M — 



2 cos 9w 



(A.2) 



(A.3) 



(A.4) 



& = una + &)/4, # = e«(Cct - ^)/4 



(A.5) 



Finally, /c 2 is the mass of the gauge boson and n is the renormalisation scale. The sum of 
the graphs is of course finite and the result independent of \x. 

The contribution from graphs with only neutral pseudoscalars is given by 
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J dx ^-z log - log 7^ {Cv a v - Ca°a) 



+ dxdy 
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J dx ^-x log ^ - lo S 7^ fevax + d«v) 
+ j dxdy ^-1 - log ^ - ^-^) (f £a A - dav) 
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C A = m\ jdxdy-^ (tfa v + ^a A ) - (^a v - ft}a A ) 

D A = mlJ dx dy + ^a v ) - (#<U - ^a v ) 
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where 



and 



f3 A = (1 - x ) 2 m 2 t + xm 2 A 

A (1 — x)m 2 + xm A 
(1 — x) 2 m 2 + xm 2 A 

r\ A = (1 — x — y)m 2 A + (x + xy + y 2 )m 2 — xyk 2 + it 

^ = utct - &)/4, d = + e; c )/4. 

The graphs involving both the scalar and pseudoscalar particles give: 

m t C 1 - y-xy- x 2 Y 



A M = a M J dx dy (df 1 (- log ^ + 
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where 



1 - y - xy - x 2 _ M2 l-y + xy-2x + x 2 

^Ml W ^M2 
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and 



= - £t* c )/4, er = + Cc)/4 
^ 2 = + &)/4, = - o/4. 

Finally, the contribution from graphs involving the charged scalar is 

• i 
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where , 

P C = x{m 2 _ (1 _ x)m 2 t) 



f>2 

r] C1 = (1 — x — y)(m 2 ± — inij) — xy/c 2 + ze 

r^ 2 = (x + y)m 2 ± — y(l — x — y)m 2 — xyk 2 + ie, 

¥2 



and the couplings are 
for the photon and 



for the Z°. 



(A.13) 



al = ^ = J2 = e (A.14) 



4 = -f^, 6f = -47-(l-!«U Jf = ^(l"2^) (A.15) 
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Figure Captions 



Fig. 1. Feynman diagrams contributing to the decays t — > 07 and t — > cZ° 

Fig. 2. Branching fraction for t — > 07 and £ — > cZ° — > ce + e~ + c(i + fi~ divided by the 
product of coupling constants (^tt^ ic ) 2 plotted as a function of a common scalar 
mass. The solid, dashed and dot-dashed curves correspond to a top quark mass 
of 110, 150, 180 GeV respectively. 
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Figure 1 
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Figure 2 




13 



